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Abstract 



We propose an algorithm for approximating the solution of a strongly oscillating SDE, 
i.e. a system in which some ergodic state variables evolve quickly with respect to the other 
variables. The algorithm profits from homogenization results and consists of an Euler scheme 
for the slow scale variables coupled with a decreasing step estimator for the ergodic averages 
of the quick variables. We prove the strong convergence of the algorithm as well as a C.L.T. 
like limit result for the normalized error distribution. In addition, we propose an extrapolated 
version that has an asymptotically lower complexity and satisfies the same properties as the 
original version. 



where is a (ia;-diniensional process, a dy-dimensional process, W and W are two inde- 
pendent Brownian motions of dimensions and dy, and the functions 6, cr, / and g have the right 
dimensions. 

This type of system models the dynamics of two sets of interacting variables evolving in different 
time scales. The difference between time scales is controlled by the parameter e. In many domains 
the most interesting case of study is that of the regime when e <C 1, representing the case in which 

is evolving in a slow time scale compared to Y^ (for this reason we will frequently denominate 
them as slow scale and fast scale variables respectively). This regime may be studied by singular 
perturbation techniques as the ones presented in Bensoussan et al. [1978] for deterministic models: 
instead of looking at the system with a small e, we study the limit of (1) as e — >■ (when it exists) 
and estimate the error induced by this approximation. 

There exist several analytical works with applications in different domains on the described 
type of approximation for stochastic models. For example in Majda et al. [2001] a climate model 
is considered and studied on the advection scale (i.e. in the time scale of the slow scale). In 
Fouque et al. [2000] and Fouquc et al. [2003] a system similar to (1) is presented and studied for 
pricing derivatives in the context of stochastic volatility models. A complete study with rather 
general hypothesis on the coefficients of the system is found in Pardoux and Veretcnnikov [2001] 
and Pardoux and Veretcnnikov [2003] . In these papers a system with a fast scale ergodic diffusion 
is considered. More precisely if 



1 Introduction 



Consider a system of stochastic equations of the form 



XI = xo + !l f{XlY-)ds + g{Xl Y-)dW, 

F/ - 2/0 + e-' /J b{Xl Y^)ds + e-V^ a(Xl Y^)dW, 



(1) 





is ergodic with unique invariant measure /i^, we might define the effective equation 




(3) 



F{x) = / f{x,y)^l^{dy) G{x) = ./H{x) H{x) = / h{x,y)^l^ (dy), 



(4) 



where h{x, y) = gg*{x, y), and G{x) could be in principle any matrix with square given by -ff, but 
we choose it to represent the Cholesky decomposition of the positive semi-definite matrix H. It 
follows that under appropriate assumptions X'^ — > X as e — > (c.f. Pardoux and Veretennikov 
[2003]). The idea behind this kind of singular perturbation method is that when the difference 
between scales is large enough, the dynamics of the system behave as if the slow scale would be 
frozen and the ergodic limit of the fast diffusion would be attained. 

However, except for a few particular examples, it is not an easy task to find explicit expres- 
sions for the averages (4). Naturally, this leads to the question of designing numerical methods 
of approximation of the effective equation. Several methods have been developed for a purely 
deterministic case (see for example the review E et al. [2007]). Most of them are based on choos- 
ing a macro-solver for the slow scale in which some information from the fast scale is added via 
parameters introduction to guarantee the correct approximation. 

The literature with respect to numerical approximation of the general stochastic case is, to our 
knowledge, much more restricted. In E et al. [2005] the authors present an algorithm based on 
the use of an approximation scheme for the slow scale (for example the Euler scheme) and at each 
step of the slow scale another scheme is used to solve for the fast scale contribution; it includes 
as well a weak and strong error analysis of the algorithm on the particular case of an ODE slow 
scale equation and a stochastic ergodic fast scale variable (i.e. when g{x,y) = in (1)), and a 
weak error analysis for the full stochastic case. 

In our work we use a similar approach. We propose a Multi-scale Decreasing Step (MsDS) 
algorithm defined as a composition of an Euler scheme for the slow scale, the decreasing Euler 
step algorithm and estimator proposed in Lamberton and Pages [2002] for the ergodic average 
approximation at each step, and a Cholesky decomposition for finding the volatility coefficient. 

In order to control the total error approximation of this proposed algorithm we need to take 
into account four effects. First, we need an estimate on the ergodic average approximation at each 
step. We show that this control is based on the existence, regularity and control of the solution 
of the Poisson equation associated to the fast scale diffusion 



when considering as sources (i.e. the right hand side functions) the coefficients F and H centered 
with respect to their respective invariant measures. Second, we need to control the error obtained 
after performing a Cholesky decomposition. Third, we have to account for discretization errors. 
Finally, we need to control the error propagation which will be possible under some growth control 
on the coefficients of the effective equation. 

The MsDS algorithm strongly converges to the exact solution and proves to be more efficient 
than a simple Euler scheme for highly oscillating problems. Moreover, it features a non-standard 
C.L.T. property in the sense that the normalized error distribution converges towards the solution 
of a SDE. The coefficients appearing in this normalized error SDE depend on the solution of the 
previously mentioned Poisson problem and are, in general, unknown. Nevertheless, the available 
explicit expression for them is valuable for the estimation of confidence intervals and eases the 
task of parameter tuning for actual implementation of the algorithm. 




(5) 



where 
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We study as well an extrapolated MsDS (EMsDS) version of the algorithm, differing from the 
original one in that it uses as estimator of the ergodic average a Richardson- Romberg extrapolation 
of the decreasing step estimator (i.e. a well chosen linear combination of the decreasing step Euler 
estimator with appropriate parameters). As the MsDS, the EMsDS also features a non-standard 
C.L.T. property and shares the same rate of convergence. However, the extrapolated version has 
lower asymptotic complexity and hence higher asymptotic efficiency than the original one. 

1.1 Outline of the paper 

The organization of the paper is as follows: in section 2 we present our general framework (proba- 
bility space and main hypothesis). Then, we proceed to describe the algorithm in its two versions 
(with and without extrapolation); the main results (strong convergence, limit distribution and cost 
analysis) and some numerical tests illustrating the results: this will be the plan for section 3. The 
remainder of the paper is devoted to develop the proof of the main theorems in three steps: first, 
on section 4, we remind some known regularity properties of the effective equation and available 
results on the decreasing Euler estimation algorithm; then, on section 5, we prove the convergence 
and limit distribution results for the MsDs algorithm; finally on section 6 we extend those results 
to the EMsDS algorithm. We close this paper with the proof of a technical result on convergence 
of a tuple used in the main proof. 

2 Probability space and standing hypothesis 

As mentioned in the introduction, the algorithm may be seen as the composition of two procedures: 

• An Euler scheme for approximating the effective equation (3). 

• Independent realizations of a Decreasing Euler step estimation algorithm as proposed in 
Lamberton and Pages [2002], which are used at each step of the Euler scheme to approach 
the ergodic average in the coefficients. 

We introduce a probability space with a particular structure that will be appropriate for 
studying such an algorithm. Consider the space (n,J^, P) with an adapted Brownian motion 
W. Suppose as well we are given an independent probability space (f2, J", P) and a family of 
independent Brownian motions W'^,q £ Q with an associated filtration J^' :— a{W^,s < t}. 
Define the extended space (fi,^, ^t,P) by 

n-.^nxn, F{duj, du) ^ V{dLo)V{dLo), 

Tl:= \/ F^, := V J",". 

Such extended space will be useful for treating independently the noise coming from the Brownian 
in the effective diffusion and the one related to the ergodic diffusion averages. Hence, we may look 
at as the slow scale information filtration while the family J^' accounts for several independent 
Brownian realizations needed to obtain independent realizations of the decreasing Euler estimator. 

2.1 Standing hypothesis 

Hypothesis (T-Ls.s.) {On the slow-scale coefficients). 
i) Lipschitz in x: There exist constants K,m such that for all x,x' E M'^^ 

\fix,y) - fix',y)\ + \gix,y)~gix',y)\ < - x'|; 
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ii) Regularity: /, h belong to C^'p for some Vy > 3, where the subindex b,p means the derivatives 
9^9^ for < i < 2 and < j < — i are bounded in x and polynomially bounded in y; 

iii) Degeneracy: Either h is identically zero, or it is uniformly non degenerate, that is, there exists 
A'_ such that X'_I < h(x,y). 

Hypothesis {T-Lf.s.) {On the fast- scale coefficients). 

i) a,b Cz C^f, i-e. they are continuous and linearly bounded in y, and and bounded in x. 

ii) The matrix a is uniformly continuous and uniformly non-degenerate and bounded, i.e. there 
exist A_, A+ € M"*" such that 

A_/ < a(x,y) := aa*{x,y) < X+I; 



iii) sup\b{x,y)\ = 0{\y\); 

X 

iv) lim supb{x,y) ■ y — —CO. 

\y\^oo X 

The regularity and growth assumptions contained in {'Hs.s.) are assumed to control the error 
propagation. On the other hand, (fHf.s.) is quite restrictive as it requires uniform bounds on x. It 
is, however, very natural to have such restrictive conditions on the fast scale diffusion as we are 
aiming to have an invariant limit for any possible fixed value of x and a uniform control on its 
averages. 

3 The algorithm 

The decreasing step Euler algorithm was introduced in Lambcrton and Pages [2002] to approach 
the invariant measure of a recursive diffusion. 

Let (7 e Q, and let y^jk+iU^+i '■= ^r^+i ~ implying that Uk+i is a standard Gaussian 
vector. Let j/o G H^'^" • We define a decreasing step Euler approximation of the crgodic diffusion by 

Y,^l\ = y^'^-' + 7fe+i6(^, n'') + V^M^, n-'WU^, (7) 

where {7fc}fceN is a decreasing sequence of steps satisfying 

Hypothesis {H-y) {On the sequence of steps for the average estimation algorithm). 

i) Ik > for all k; 

ii) 7fc is a sequence of decreasing steps with lim 7^. = 0; 

n— f 00 

iii) lim Tk = 00; where := X^LoTi; 

iv) EZi (i) < +00. 

Then, we define the decreasing step average estimator by 

^'(^''?) = i^E7,/(^'^-i) (8) 
j=i 

The idea behind the particular form of the estimator (8) is to take advantage of the ergodicity of 
the diffusion: the long term time average approaches the invariant measure of the diffusion. On the 
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other hand we use a decreasing sequence of steps in the Euler scheme to eliminate the asymptotic 
gap between the invariant law of the continuous equation and that of its discretization. We should 
remark that we have chosen to work with a simplified version of the algorithm in Lambcrton and 
Pages [2002]: the most general version of the algorithm allows the use of different sequences for 
the Euler scheme step and for the weights in the average. 

Note. In what follows, we will denote by T^J^j ~ X]fe=i(7fc)'"' in particular, fJ^! = Tm- 

With this estimator in hand we can define an Euler scheme to approach our effective diffusion. 
Assuming a time horizon T, for n G N* we put tk = Tk/n, so that the Euler scheme will be given 
by 

Xl^^ = F*^(")(xr^,tfe)Atfe+i + G''^-\xl,tk)AWk+i, 

where is defined in (8) and G^{x,q) is defined in two steps: First we find H^^{x,q) using 
the decreasing step algorithm as in (8) (recall that h{x,y) ~ g*g{x,y)) and then we perform a 

Cholesky decomposition on it to find G^^{x,q) = \J H^^{x, q). Finally, M(n) is the number of 
steps in the decreasing Euler estimator expressed as a function of the number of steps in the Euler 
scheme for the slow scale. The form of M(n) will be clear from the main theorems. 

It will be easier to work mathematically with a continuous version of the Euler approximation. 
Let us denote by t{n) — \nt\ / n and we will usually omit the explicit dependence on n and write 
t when clear from the context. We define the continuous Euler approximation by 

XI' = xq + (^", s) '^^ + {K^^ '^^^ (9) 

Note that at times tk the continuous Euler coincide with the Euler algorithm. All our results will 
be derived for this version of the algorithm. 

Remark 3.1. For implementation purposes, it could be more convenient to calculate the estimator 
F" (similarly i?") recursively as 

F°(x,g)=0 

F\x, q) - F^-l(a;, g) + ^ (/(a;, - F^-\x, q)) 

Let us state our main Theorem on the MsDS algorithm. Its proof is found in section 5. 

Theorem 3.2. Let < < 1, 70 G and = Jok^^ ■ Let Mi he a positive constant. Assume 
(Hf.s.) and (Hs.s.)- Define M(n) by 

M{n) = Miu^ , 

then 



i) (Strong convergence), lim E 







2" 


sup 






.0<t<T 











ii) (C.L.T like result for the ODE case: G{x) = Q). Assume in addition that r^ > 7 and 1/2 < 9. 
Then 

n (Xt - X") =: C" => C°° 
for given as the solution of the system of SDEs 

Cr-' = E d,^F\X,)C^^^ds + i ^* d.,,F\X.,)F^{Xs)ds 
ft 



g / ^'^{X,)dBl 
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where is a dx~ dimensional Brownian motion independent of W ; _F*,G"'-', are the en- 
tries of F, G, C. respectively; and ^p'p are functions depending only on the coefficients b, a, 
the constants Mi ,jo,9 and F and its derivatives up to order 4, and are explicitly given in 
Proposition 5.11. 

Hi) (C.L.T like result for the SUE case G{x) ^ Q) Assume in addition that r^ > 7 and 1/3 < 6. 
Then 

n^/^ (Xt - X") =: C" ^ C°° 
for given as the solution of the system of SDEs, 

=E ^fj.^F\X,)CT^^ds + f^B!^{X,)dWl^ 

+ E f dx.G-\X,)adWl+ f ^f \x,)dBf^^'^ 

+ ^ E f dx,G^\X,)&'\X,)dBl^^'' 
^2 i.j,k=i -^0 

where B^ is a d^ and B^ is a d'?^ x dx dimensional Brownian motions independent between 
them and independent from W ; Rq , 93 q'' ' are functions depending only on &, a, the constants 
Mi,7o,0, F and its first derivatives, G and its derivatives up to order 4, and are explicitly 
given in Proposition 5.11. 

As will be clear from Proposition 5.11, the coefficients Rq^ , f^p and ip"^'^'^ are explicitly given 
in terms of the invariant law of the ergodic diffusion and are consequently unknown. The key 
point is that, being explicit, they might be estimated numerically for practical purposes. 



3.1 Extrapolated version 

The extrapolated version of the algorithm follows the same basic structure of the MsDS algo- 
rithm but we use as estimator a Richardson-Romberg extrapolation: a linear combination of the 
estimator with two different set of parameters chosen to reduce the complexity of the algorithm. 

Indeed, let A be a positive real. If {7^} is a sequence of steps satisfying {%^), then the sequence 
7^ := ^ will also satisfy {T-Lx). We will denote T\j and T^}''^' the sum of the 7^ and their r-power 
as before. 

Let us denote by F^'^\x, q) the ergodic average estimator as defined in (8) when the coefficients 
{7^} are used. 

We define an extrapolated approximation estimator as 

F(")^^a;,<z) - ^ (AF^'*^(")(a;,g) . (10) 

In analogy to the MsDS case, we define G^-^-^f") (x, g) = H^-^'<-^){x,q) for H^'^'^"^{x,q) defined 

applying (10) to h. We denote as well X the continuous approximation (9) with coefficients given 
by the estimators just defined. 

Theorem 3.3 shows the advantage of using the EMsDS algorithm: assuming higher regularity, 
all the properties of the MsDS algorithm are conserved but the extrapolated version allows a lower 
value for 9 in the definition of the sequence 7^ = jok~^ ■ More precisely we pass from 1/2 to 1/3 
in the ODE case and from 1/3 to 1/5 in the SDE case as minimal 6 values. As a consequence of 
this reduction, the complexity of the modified version is in general asymptotically lower than that 
of the non extrapolated version (refer to the efficiency analysis on subsection 3.2). 
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Table 1: Minimal efficiency (operations for fixed error) of the basic and extrapolated algorithm 
for ODE and full SDE cases 





ODE 


ODE (extrapol.) 


SDE 


SDE (extrapol.) 




1/2 


1/3 


1/3 


1/5 


rmin(A) 




0{d,dyA-^-^) 


0{[dldy + dl]A-^) 


0{[dldy + dl]A-^-^) 



Theorem 3.3. LetO < 9 < I, jo € K+ and -jk = 70^"^- Assume {Hf.s) and {Us.s.)- With M{n) 
defined as in Theorem 3.2. 

Let be the approximated diffusion where we replace the ergodic estimator (8) by (10). Then 

i) (Strong convergence), lim E 









2" 


hm E 


sup 








0<t<T 









a) (ODE case: G{x) = 0/. Assume in addition that r?^ > 8 and 1/3 < 6*, then C" := n {^Xt - X"^ 
satisfies the limit distribution result given in Theorem 3.2 ii). 

Hi) (SDE case) Assume m addition that r?' > 8 and 1/5 < 6,. Then C — n^'"^ [Xt - X"^^ 

satisfies the limit distribution result given in Theorem 3.2 Hi) with new coefficients , BP , (p^ 
and ifP that will be given in Corollary 6.1. 

The proof of Theorem 3.3 is given in section 6. 
3.2 Efficiency analysis 

We can approximate the execution time of both algorithms by estimating the total number of 
operations needed to perform one path approximation of the effective equation (3). Note that 
since both algorithms share the same structure, a similar analysis is valid for both of them: the 
total cost K{n) of the algorithm with n steps may be written as 

n{n) = [Ki(n,d.^,dy) + K2{d.^)]n, 

where ki stands for the cost coefficient estimation at each step of the decreasing Euler, and K2 for 
the cost of calculating the Euler iteration. The latter will be of order 0{dx) in the ODE case and 
0{dl) for the SDE case. 

Let us focus now on ki. Both algorithms perform Miu^^^^^^^ iterations for approximating 
the diffusion Y and the calculation of estimators F, G. For the MsDS algorithm, each one of this 
iterations has a cost of 0{dydx) in the ODE case, or 0{dyd^) in the SDE case. In the latter, we 
need also to perform a Cholesky decomposition with a cost of 0{d'^) operations. Hence, 

.MsDS(„ . w ^ - in ODE case 

' ^ ' \0([dX + 4y/^'"'^) in SDE case ' 

On the other hand, from the definition of the EMsDs algorithm, we get nf^^^^s < ^^MsDS ^ g^^^^j 
thus both share the same order of complexity, with the only difference that 9 is allowed to be 
smaller in the extrapolated algorithm. 

It may be more interesting to compare the efficiency of both algorithms, that is the time spent 
to obtain a given error tolerance A. We have from theorems 3.2 and 3.3 that A(7t.) := 0{n^^) for 
the ODE, and A(n) := 0(n-i/2) for the SDE case. Replacing the minimum possible 9 values we 
obtain the complexity figures given in Table 1. 

How do these figures compare with a straightforward Euler scheme applied to the original 
system? For the ODE case, an Euler scheme implemented for the original system (1) would 
require a total of {dx + dy)e~^ A~'^ operations. Then the MsDS algorithm is more efficient if 
e < A{dx V dy)-^, and the EMsDS if e < A^^^id^ V dy)"^ With respect to the algorithm 
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presented in E ct al. [2005], the efficiency is equivalent to the one obtained when using a weak 
scheme of order one for approximating the ergodic averages. The advantage of our method is that 
we have in addition to the rate of convergence an expression for a C.L.T. type result. 

In the SDE case, on the other hand, the proposed algorithm will be advantageous in the case 
in which e < A^{d^ V dy)~^ for the MsDS version, and e < A^-^{da: V dy)~'^ for the EMsDS. In 
other words, our proposed algorithms will be more efficient in our regime of interest of a strong 
scale scale separation (i.e. when e — J' 0). It should be remarked that the SDE case is not explicitly 
studied for the algorithm in E et al. [2005] . 



3.3 Numerical tests 

To illustrate the main features of the algorithm, we present in this section its numerical behavior 
when used for solving a toy system for which we are able to obtain an exact solution. Consider 



dYt = W , „ , , -Yt]+ V2dWt, 




which is an Ornstein-Uhlenbeck system having a unique invariant measure distributed A/" ((I a; 1 2 + 
and define the SDE system 

dX^' = F{Xt)dt + G{Xl)dWt, 

with 

:^(' + '- 'If + 

The form of the assumed coefficients is chosen to satisfy the regularity and uniform bound hy- 
pothesis in {Jig s ) and {T-Lf ^.) and to give a simple effective equation expression. In fact, it is 
easily verified that the exact effective equation is 




X. 



xl + s + W} 
xl + s + Wl+ 



We will look at the numerical results of applying the decreasing step with sequence 7^ — k'^^/'^ 
and the EMsDS version with sequence 7fc — k^^^^ and A = 3. Let us examine the distribution of 
the error at a fixed time T = 1 (i.e. C = -^1 ~ -^1 )■ Figure 1 shows a Q-Q plot of the rescaled 
simulated errors \/nC, and the limit distribution error in the studied cases. As shown, the empirical 
distributions obtained after 1600 simulations with n — 510 verify the expected limit behavior. 

Figure 2 Left plots in a log-log scale the evolution of the L2 error 



1/2 



sup 

.0<t<T 

in function of the number of steps n, comparing both versions of the algorithm. The empirically 
obtained slope ( close to —0.5 in both cases ) represents the power of the approximation and is 
the one expected from the convergence theorems. 

We show as well in Figure 2 Right a comparison in the efficiency of both methods (measured 
as the error in terms of the execution time) of each one of the algorithms. The effect of the 
extrapolation in the cost of the algorithm is evidenced in the difference in slope of the empirical 
plot for both algorithms. Note that solving for A in Table 1 we get AmsDS = 0(t~°'^) and 
A-EMsDS ~ 0(t^"-^^^), values that are retrieved in the numerical experiment. It is worth observing 
the difference in the intercept of both lines, showing that the higher slope comes with a cost in 
the initial error. The conclusion drawn from the example may well be generalized: the user 
should consider implementing the extrapolated version when requiring a very high precision on 
the approximation results. 
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QQplot - XI - Basic 



QQplot - XI - Extrapolated 



Normalized observed error (n"^ - (X-X)) 
QQplot - X2 - Basic 



-0.6 -0.4 -0.2 0.0 0.2 0.4 0.6 

Normalized observed error (n''^ (X-X)) 



QQplot - X2 - Extrapolated 





Normalized observed error (n ' (X-X)) 



Normalized observed error (n''^ (X-X)) 



Figure 1: QQ-plot comparing the rescaled errors in the simulation with n — 510 and the theoretical 
limit distribution ( the reference line represents a perfect match). Left : SDE decreasing step. 
Right: SDE interpolated. 



L error vs. steps 
I Basic (rate: -0.49) Extrapolated (Rate: -0.5) 



L error vs. execution time 



I ,Basic (rate: -0.2) Extrapolated (rate: -0.22) 



1e+03 
Time (ms) 



Figure 2: Left: L2 error as a function of steps for the SDE case (log-log scale). Note that the 
estimated values for the slopes verify the rate of convergence for the algorithm in both implemen- 
tations. Right: L2 error as a function of execution time for the SDE case (log-log scale). Although 
a higher price must be payed for a small step number, the slope difference signals a change in the 
asymptotic order of convergence. 
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4 Preliminaries 



To prove our main results we will need to use different techniques and results related to the 

interacting steps of the defined algorithms. In this section wc present briefly some results from 
the available literature (with some slight modifications) that will be helpful for our task. 



4.1 A priori estimates 

An important result is related to some a priori estimates valid for general SDEs. Since they are 
quite standard, we will state the result without giving the details of the proof. 



Proposition 4.1. Let 



Jo Jo 



(11) 



where V\ , V2 are adapted random functions, 
i) For all a>2, 



E 



sup |l?t| 
.0<t<T 



<i^„E[|^or]+if(a,T) / (E[|l/i(^9„s)r]+E[|y2(t?a,s)r])ds 

Jo 



and consequently 
E 



sup 

0<t<T 



<K^E[\^on+K{a,T)( snp E[\Vi{'&t,t)n + sup E[\V2{'&t,t)\' 

\0<t<T 



0<t<T 



ii) Assume that Va > 2, 



E[\Vr{^t,tT]+E[\V2{dut)n<K{l+E[\dt 



Then, 



a) Forte [0, T] and a > 2, E < K{a, T) 



b) Fora> 2, E 



sup |l?s|" 
0<s<t 



< K{a,T) 



c) Let Tr = inf{t : >r}. Then 



K(a,t) 

sup Tr <t ] < 

o<s<t J r" 



4.2 Cholesky decomposition 

The Cholesky decomposition of a positive definite matrix consists in expressing this matrix as 
the product of a lower triangular matrix and its conjugate transpose. A stability analysis of this 
procedure is a key point in our analysis for the SDE case behavior of our algorithm. 

Recall that we denote by | • | the induced operator norm. Let us denote by || • ||f the Frobenius 
norm. Recall that if is a d x d matrix 



\H\ < \\H\\f < 



(12) 



10 



Theorem 4.2 (Theorem 1.1 in Sun [1991]). Let H be a dx d positive definite matrix with Cholesky 
factorization H — GG* . If AH is a d x d symmetrical matrix satisfying 

\H-^\\\AH\\f < 1/2 

then there is a unique Cholesky factorization H + AH = (G + AG){G + AG)* and 

\G\ l + Vl-2.2(i/)K' ^ 

where K2{H) = \H\\H-^\ and 

llAi^ll. (^^^ 



1^1 

Theorem 4.2 gives a control on the sensitivity of the Cholesky procedure. We might study 
the propagation effect at each stage of the Cholesky factorization to say a little bit more on the 
particular form of the error. 

Lemma 4.3. Suppose the hypothesis of Theorem 4-2 hold. Then, 

AHi^i — 2 ^ AGi^kGi^k 
AG,, = ^ + 0(|Ai/n, (15) 

AHij — GijAGjj — J2 {^Gj,kGi^k + AGi^kGj,k) 
AG,,, = + 0{\AH\') (16) 

for i > j. 

Proof. Since G + AG is the lower triangular factor of i? + AH, we have 

i-i 



{Gi,i + AGi^if — Hi,i + AHi,i — ^(Gi^fe + AGi,kY 



fc=i 

By algebraic manipulation and the fact that G is the Cholesky decomposition of H we get, 



AHi,i — 2 ^ AGi,kGi,k / i-i 
AG,, = [{AG,,,r + Y,{AG,,kr 



k=l 



The first claim follows by controlling the last term by induction in i. Theorem 4.2 and norm 
equivalence given by (12). The case z > j is proved in the same way. □ 

Lemma 4.3 gives a first order approximation of the error matrix AG knowing the perturbation 
matrix AH. Moreover, we can deduce on the regularity of the Cholesky approximation. 

rdxd 



Corollary 4.4. Let H : M — > M he C^ and non- degenerate (in the sense given in hypothesis 

-'b 



(TLs.s.)- Then G is also C^ and non- degenerate. 



Proof. The non-degenerate and boundedness part follows since from the definition, |Gp = |GG* | = 
\H\, so that ^/aT and •\/A+ are respectively upper and lower bounds for |G|. The regularity claim 
is proven from the limit definition of the derivatives using the result in Lemma 4.3. □ 
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4.3 Decreasing step Euler algorithm 

In this section we present some control and error expansion results valid for the Decreasing Step 
Euler algorithm. The results here presented are found in Laniberton and Pages [2002] or in the 
PhD thesis Lcmaire [2005]. 

A first interesting property is that the sequence of estimators defined in (8) converges almost 
surely to the ergodic average for any fixed x. 

Proposition 4.5. Assume {Hf,s.), and let tjj '■ — > for some d' g N*, and suppose that 
^ix,y) < C(x)(l + lyl""). Let be defined as in (8). Then, for any x e W^^qE Q, 

*«(.,,)^/,K..,K(*).»M-oo 

where fi^ is the invariant measure of (2). 

Proof. {Hf s.) imply that V{y) := 1 + |?/|^ is a uniformly in x function satisfying the hypothesis 
of Theorem 1 in Lamberton and Pages [2002], from which the claim follows. □ 

We have as well a control on the moments of any order of Y^''^ . 

Proposition 4.6. Let vr > and let Y'j^''^ he given by (7). Then there exists a constant K^^ given 
only by tt, A_, A+ and 70 such that for all x e M'*^ and q G Q 



supE 



\Y" 



Moreover, for every n > 1, 



AfeN \ J- M ~^ I 



Proof. By Lemma 2 in Lamberton and Pages [2002] given that C/' has moments of any order and 
^{y) = I2/P + 1 satisfies the needed hypothesis uniformly in x, we get that for any tt > 1 and 



supE 



\Y 



x,q\2TT 



< supE 

ieN 



The extension to all tt > is straightforward. 

The second claim is a consequence of Theorem 3 in Lamberton and Pages [2002] . □ 

Proposition 4.7 is an adaptation of an expansion result appearing in the PhD thesis (Lcmaire 
[2005] ) . The proof comes from performing a Taylor expansion and reordering the terms in a proper 
way. 

Proposition 4.7. Let ip : ]R'^== — >■ M. Under the assumptions of Proposition 4-5, suppose that 
there exists 4>^ solution of the centered Poisson equation 



Cl<i)4x, y) = -^pix, y)- J i,{x, z)n''{dz) (17) 

Suppose as well for r G N, r > 2, that (p^ is C in the y-variable uniformly in x, and D^cj)^ is 
Lipschitz in y uniformly in x. Let jk and rjk be two decreasing sequences with 7^ — > 0, 77^ — > 0, 
i<j<k"ik, T-Lk - J2i<j<kVk- Let Yj^''^ be defined as in (7) (with step sequence jk)- Then, 



k=l \ J J 
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where 



M 



^%,M^^^l) 't'^ix^Yk''^) - <PA^^^i^-\) 



k=l 
M 



Ik 



k=l 
M 



/Ik 



k=l 



Tr[D'M^^Yk-\){<^*^i^^n-\) 



M 



(18) 
(19) 
(20) 

(21) 



for i = 3, . . . , r with 



V 



iAr 
3>%I1 



k=l 



.^Dl4>4,{x,v) ■ (5(a;,y)«('-^"),(a(x,y)z)«(2,-.) 



and 



M 



|z;,Ml(x,g) < K^vki^ii + \nL\Y+'){i + \ui\y+\ 



(22) 



fc=i 



Remark 4.8. We may interpret Proposition 4.7 as an error expansion result. Indeed if we fix 
"Hk = Ik satisfying {T-L-y) then we will have an explicit expression for the approximation error of 
the decreasing Euler algorithm. 

The average of each expansion term will play an important role in our analysis, so that we will 
present a special notation for them. Indeed, let 



E .) V^'^^(^,2/)E[(&(2:,y)^('-^'\(^(a;,y)C/{')«(2,-.)^ 

j>i/2 ^* 
iAr 

E 



(23) 



.1 \\Dlcj^^{x,y)¥. [(6(a:,y)«('-^"),(a(a:,2/)C/,^)«(2,-,)\|^j,^_^ 



Remark 4.9. Consider for i< [(r - 1) /2J . As 2j - 2i - 1 is odd for any j integer and given 

the fact that the odd powers of a centered Gaussian are centered we deduce v'^'^^'^ = 0. Of course 
this property transfers to A'^\^ so that E A^^^ = 0, implying in turn that the terms with an 
odd index are centered. 

Under some additional hypothesis. Proposition 4.7 may be used to obtain a L2 control on the 
error of the approximation. 

Proposition 4.10. Under the assumptions of Proposition ^.7, let a>l. Assume {7fc} satisfies 
(T-L-f), and that T^^j — > 00. Assume as well that the solution of the centered Poisson equation (j)^ 
is in C^'p for r > 3. Let ^ := J 'ipix, z)fM^{dz), then 



E 



1 

^Y.^tiiAx.nL\)-nx) 



M k=l 



< K- 



A + T 



;2q-1] ^ -p[2] ^ cp[a+l]^,2 
M 
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Proof. We recall first some martingale inequalities. Let {ofe} be any sequence of random tensors. 
By Cauchy-Schwarz inequality we have that 



E 





M 


T 




M 


M 








< E 








k=l 






k=l 


fe=i 



(24) 



Let {bk} be also a sequence of tensors. If sq < Si < . . . < Sfc < . . ., the {flfc}, {bk} are J^^ adapted 



and for all k, E 



E 



E 



M 



0, we have by martingale properties that 



M 



\k=l k=l 



M 



fe=i 



and in particular 



E 



M 



k=l 



M 



(25) 



(26) 



k=l 



Now, take the error expansion in Proposition 4.7 with r — 3 and Let rjk = Ik - Reorganizing the 
sum, using convexity, the estimate (24), the regularity properties of 0^ and Proposition 4.6, we 
get 



E 



I^^.,m(^>9))P 



E 



M 



E7r' M^X'')~M^^yk-\) 



k=l 



E 



M-l 



fc=i 



< 3E 



3E 



■3E 



(27) 



A;=l 



< K 



lk+l)M^^Yk'') 
(7m + ( E (7^-7^+1^)1 



, fc=l 



Moreover using the fact that the terms are centered from Remark 4.9, equation (26) and the 
finite moments of the Brownian increments imply 



fc=i 



< KT 



M 



AI 



E[\Al^,i^,q)\^]<-Y,llE 



fe=i 



(28) 



(29) 



< KT 



Ai 



More generally, estimate (26) leads to 



M 



E[|4,,,(.,g)P] =^7f+^E |.^f(x,f -!,[/,') 



fc=i 



< KT 



'2a+l] 
M ' 



(30) 
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while by virtue of (24), we find as estimate 



k=l 



<x(r["/ii)2 (31) 



On the other hand, from ("H^) and given that F^^' cx), we have for M large enough that if i > j 

-pi'] p[il 

— ■ 

The claim follows from Proposition 4.7 and equations (27), (28), (29), (30), (31). □ 
4.4 Ergodic average and Poisson equation 

Being basic to our analysis, we introduce in this section some known properties of the exact 
averages and the effective diffusion. These results are studied in Pardoux and Veretennikov [2001] 
and Pardoux and Veretennikov [2003]. 

Let us start with some control results. In Veretennikov [1997] it is shown that for any given 
a, we have a uniform bound for the moment of order a of the marginals of solution of (2). 

Proposition 4.11. Let a > and let Yf be the solution of (2) with deterministic initial condition 
Uq and coefficients satisfying [T-Lf g ). 

Then there exists a constant K given only by a, A_, such that for all t > Q and x € M.'^'^ 

E[\Yfn<K{l + \yor+'). 
This proposition has a natural corollary 
Corollary 4.12. Under the same hypothesis of the theorem, for any a > and all x G 

W^i^dy) < K. 

Lemma 4.13. Let ip{x,y) be a function satisfying the regularity and growth conditions in ('Hs.s.), 
and let ^(x) = / tp{x,y)/j,'^{dy), then *(x) is . 

Proof. The claim follows from adapting Theorems 3 and 5 in Veretennikov [2011] to the linear 
growth case: the needed equivalent results of convergence in total variation and control of expec- 
tations may be found in Meyn and Twcedie [1993]. □ 

Proposition 4.7 shows that the solution of the centered Poisson equation (17) plays a special role 
in understanding the error expansion of the decreasing Euler algorithm. Proposition 4.14, which 
is an adaptation of Theorem 1 in Pardoux and Veretennikov [2001] and Veretennikov [2011], states 
some sufficient conditions for having the solution of such an equation when / belongs to a certain 
family of functions. 

Proposition 4.14. Consider a function '>p{x,y) satisfying the regularity and growth conditions in 
(jHs.s.) o,nd such that 

^{x,y)fj,''{dy) = 0,Vx. 



Assume {Hf.s.)- Then, there exists a function (j)jf,(x,y), continuous in y and belonging to the class 
C\p>i ^pioc V' such that for every x E M'*^, 



i) £l(j)^{x,y) = il}{x,y), 
a) J (j)^{x,y)n''{dy) = 0, 
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iii) 0.0 G Cl'f . 

This function is the unique solution up to an additive constant of the Poisson equation on the 
class of continuous and np>i ^p/oc functions in y which are locally bounded and grow at most 
polynomially in \y\ as \y\ ^ oo. Moreover, it has the representation 

/>oo 

(j)^(x,y) = - E^,y{tP{x,Yt'))dt 
Jo 



5 Convergence results for the MsDS algorithm 

We focus now on the study of the MsDS algorithm. First, wc show that the proposed approximated 
coefficients (by means of Decreasing Euler step and Cholesky procedures) satisfy a growth control 
and error control properties. As a consequence, we will conclude on some regularity property of 
the approximated diffusion (9) and show its strong convergence towards (3). Then, we will study 
the limit error distribution property. 



5.1 Existence, uniqueness, continuity 



It follows from Hypothesis (Hs.s.), {T~Lf.s.): Proposition 4.11 and Proposition 4.1 that there exists 
a unique solution to equation .3, and that it has a continuous modification. We show the defined 
approximation has the same properties. 

Proposition 5.1 uses the results of section 4 to show that, under the standing hypothesis, the 
coefficients of the approximated diffusion have finite moments of any order, and that its error with 
respect to the exact coefhcients decrease as a power of the number of steps n. 

Proposition 5.1. Assume (Hs.s.), ('H/.s.) and (H-y). Let /3o > 0, and define M{n) implicitly by 
rAf(ri) — Con^^" , where Co is some constant. 

i) There exist 4>p and 4>h solutions of the centered Poisson equations 



^l<l>Fix, y) = f{x, y)- J f{x, y)lJ-''{dy'), 
^l<pHix,y) = h{x,y) - / h{x,y')n''{dy'), 



ii) Let 



min ^ 0) A min ^ 0) A (r^ + 1) 

l>A,i=l,...d l>4,t,j = l,...d 



(32) 



( with the convention that min(0) = oo) and , v''^ij defined as in (23) applied to , . . . , F'^" 
ffi'\ . . . ,71''==^''-. Assume that 



p[<;/2] 

lim = dn-^i + oin-'^') 



(33) 



for some /3i > and some constant Ci. Let 

/3:=/3oA/3i. (34) 

Then F"^ (and respectively iJ", G" := V iJ" j satisfies for any a £ K"*" and k = 0, . . . ,n 

\F''{x,tkT] <K 
|F"(x,tfc) - F{x)\^] < Kn-^f^. 
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Remark 5.2. We should understand <; as marking the first non-zero value in the error expansion 
of either F" or if", depends exclusively on the coefficients of the effective and ergodic diffusion 
(in particular it does not depend on n). 

Remark 5.3. Proposition 5.1 means that we have a rate of convergence in norm L2 for the coefficient 
estimators of order 0{n~^). Since we choose /3o by taking M(n) as needed, the actual limit to /? 
comes from /3i. But of course, increasing /3q implies growing M faster as a function of n, increasing 
the algorithm's cost. 

Proof of Proposition 5.1. Note first that i) follows from {Hs.s.) and Proposition 4.14. 

We prove ii). By Jensen inequality and Proposition 4.6 we have for every a > 1 and n big 
enough, 



E 



\F"{x,qr 



M 



k = l 



< E 



1 *^ 

^T.^k\f{x,Y,^i\r 

M 



k=l 



and similarly for every a > 2 



E 



|G"(:E,g)rl =E[|ff"(a;,9)r/' 



since |Gp = The result extends trivially to every a > 0. 

It remains to prove the error control. We obtain an expansion of order ry in Proposition 4.7. 
We can bound the first terms as we did in Proposition 4.10 by taking a — 1. More generally, from 
the definition of q in (32), we have that for every I < q oy I odd w^;" (x, y) — 0, hence (26) leads to 

M 



E 



(35) 



k=l 



while for even / with I > q,hy virtue of (24), we find as estimate 



M 



E 



(36) 



Likewise, 



k=l 



M 



E 



< KE 



k=l 

1/21^2 



(37) 



Note that estimates (35) and (36) are uniform in x. On the other hand, from {H.y), we have 
for M big enough and I < r^ that 

p[2l p[3] 

Hence, from Proposition 4.7 and equations (27), (28), (29), (35), (36), 



E 



\F^-^"{x,q)-F\x,q)\' 



< 
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implying our claim for F, F". Since H satisfies the same properties than F, the claim follows for 
H, H". 

As a final step, we prove the error control for G". Let us denote AH"{x, q) := H{x) — H^\x, q). 
Let E = {|Ai/"(x,q)| > \2H-^\-^} . Markov inequality gives us the control 

V{E) <4|i7-i(2;)pE[|Ai/"(x,g)p] < 7^„-2mi„(;9o,/3i) 
from this control and Theorem 4.2, we get 



E 



\Gix)-&\x,q)\' 



= E 



\G{x)-G^{x,q)\Hi 



E 



\G(x)-G'^{x,q)\H 



\G{x)-&\x,q)fl 



< _^'„-2min(/3o,,3i) _|_ ^^-2 min(/3o,ft) ^ _^"^-2 inin(^o ) _ 



□ 



We can deduce from Proposition 5.1 and the assumed structure the following a priori estimates. 
Corollary 5.4. Under the hypothesis and notation of Proposition 5.1, for any < s <T, 



E 



iF"(i«,s)r 



E 



\F-{x:\s)~F{x: 



< Kn 



-2/3 



(38) 
(39) 



The same bounds hold with F replaced by iJ", H and G", G. 
Proof. Define 



qeQ,q<t 



(40) 



by construction, is J^s,s- measurable and for any deterministic x, F^'^XjS) i J^s,s- so that we 
get from Proposition 5.1 



E 



= E 



E 



|F"(^.,^)r|j,^,- <E[K] = K. 



A similar argument leads to (39), and to the claims for iJ", H and G", G. 



□ 



Corollary 5.4 should be understood as an a priori control on the approximated process. From 
this control, we can deduce, using Proposition (4.1) as in the case of the effective equation, the 
existence and strong uniqueness of the solution of the approximated diffusion (9). In addition. 
Proposition 5.5 states that the approximation (9) has a continuous modification. The result follows 
from Proposition 4.11, the estimates in Corollary 5.4 and Kolmogorov's criterion. 

Proposition 5.5. Under the hypothesis and notation of Proposition 5.1, for every a>2 



E 



Moreover, the solution of (9) has a continuous modification. 
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5.2 Strong convergence 

In what follows, we choose X to be continuous in time. We can proceed to show the strong 
convergence of X" towards X. 

Theorem 5.6. Under {T-Lg.s.), {Hf.s.) and (Hj), let X be defined by (3) and X"' by (9). Let (3 be 
defined as in (34). Then, 

-n|2 



sup \Xt-Xl 

0<t<T 



hm E 

n— J-oo 

Proof. By definition 

Xt-X^^ f \f{x,)~f-{x^,s) 

Jo 

Our plan is to use Proposition 4.1 ?'). By convexity 
F{Xs)~F^^(^X2,s) 
< 3 
+ 3 

By Lipschitz assumption in ("Hs 







ds + 


/'[ 




Jo 



0. 



G{X,)-G'\X^,s) 



dW.,. 



Fix,) - F (^X 



-FX 



E 



E 



Fix,) - F l^X, 

F (ir) - F (^x:) 



< KE 

< KE 



Xs — Xl 



XI' - 



the last inequality being possible for n large enough thanks to Proposition 5.5. Also, by Corollary 
5.4 , we get 



E 



F 



{x:,s)-F- (^x:,s) 



Therefore 



E 



\X, - X 



n\2 



Since we may obtain similar bounds for the terms with G, we also have 



E 



GiXs)-&' (^X2,s^ ^ <is:(n-(i^'5)+E[|X, 



(41) 



(42) 



Now, Proposition 4.1 i) shows 



E 



\Xt - X 



n\2 
t I 



< K 



(n-(i^«+E 



IX, - X 



n\2 



ds. 



Therefore, by Gronwall's lemma, 



sup E 

0<t<T 



\Xt-x-\' 



Replacing on (41) and (42) we get 
FiX,)~F"(^X2,sj 



sup I E 

0<t<T 



-E 
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So that by Proposition 4.1 i), 



E 



sup \Xt-X^\ 

0<t<T 



< Kn 



-(lA/3) 



□ 



5.3 Limit distribution 

In this section we show that, under shghtly stronger regularity assumptions on the coefficients of 
the diffusion, we have convergence in the weak (uniform topology) sense towards a limit distribu- 
tion given as the solution of a particular SDE. 

Our plan to prove the limit distribution result is to look at the rescaled error and its associated 
stochastic differential equation. We prove the joint weak convergence of the terms appearing in 
that SDE and use the fact that under certain hypothesis the joint convergence of the terms suffices 
to deduce the weak convergence of the solution of the equation. The reader may find most of the 
needed material on weak convergence of stochastic integrals and stochastic SDKs in Kurtz and 
Protter [1991a] and Kurtz and Protter [1996]. 

Definition 5.7. Let X" be a sequence of M'^-valued semimartingales and let A'^{6) be the pre- 
dictable process with finite variation null at zero and M"((5) the local martingale null at zero 
appearing in the representation of X" as 



X- = X- + Al\S) + M-{5) + AX,"l{|Ax,„|>,}. 

s<t 

We say that the sequence X" satisfies property (*) if for some 5 > Q 

{M-{S),M-{5))t + f \dA-{5)^ + Yl |AXr|l{|Ax?|>^} (*) 

•^0 s<T 

is tight. (The notation jj" |c!^| denotes the total variation of A on [0,T]) 

The importance of property (*) is shown by the following theorem (see Jacod and Protter 
[1998] and Kurtz and Protter [1996]). 

Theorem 5.8. Let X" be a sequence of M.'^— valued semimartingales relative to the filtration 
J-f. Suppose that X" weakly converges in the Skorokhod topology D-^d^ . Then (*) is necessary 
and sufficient for goodness: for any sequence of {J't)— adapted cddldg processes such that 
{H"',X") ^ {H,X) in the Skorokhod topology Di^,jd^y.d^-^^d^ , then X is a semimartingale w.r.t 
the filtration generated by {H,X) and (i/",X",/ H"dX'^) ^ {H,Xj HdX) m the Skorokhod 
topology Dj^jd^xd^ xk^^x xr-^^ ■ 

Goodness gives us a direct way to show the convergence of sequences of stochastic integrals, 
and will play a key role for the convergence of sequences of SDEs. 

Before proceeding to the main propositions of this section, we cite another useful result con- 
cerning weak convergence of sequences of solutions of SDEs, allowing to compare the limit of two 
sequences with converging coefficients. 

Theorem 5.9 (Theorem 2.5 (b) Jacod and Protter [1998]). Consider a sequence of linear SDEs 

^7 = Pr + f ^'LQtdJt (43) 
Jo 

where Jt is a semimartingale, and all processes are in the same space. Suppose that we have another 
equation (43) with solution and coefficients P'" and Q'" . If the sequences supQ^^.^-^ II^INI '^'^'^ 
supo<s<ji HQ" 1 1 'f'G tight and if 

sup ||p;-p;"||Ao sup ||g';-g-||^o 

0<s<T 0<s<T 
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the 



sup 

0<s<T 



Proposition 5.10 shows the weak convergence of some tuples appearing in the rescaled error 
SDE. 

Proposition 5.10. Let X be a set of indices, and consider a family of independent standard 
Gaussian variables {i^i^"}neN*;0<fc<n:iei where for any n,i we have v^'" is rneasurahle. 

Consider the sequence of random processes A^''^ ( dimension 1), A^'^,B^''^ (dimension d^), 
B^'" (dimension d^ x d^), B^'" (dimension \2\) and B^'^ (dimension \I\ x d^) defined component- 
wise by 

B^=^- l\s - s)dWl, A?^" 2 / V - s)ds- (44) 

Jo Jo 

B^-^''r,n r ^(^; _ Wl)dWl; A^^^ := / Vi " W^s: (45) 

Jo Jo 



Bf^^-^- := / vTdWl- Br'" ■■= / 'yTds; (46) 

Jo Jo 

Then, we have the following limit results 

(X, 1", W, nA°''\y^iB^''') {X, X, W, A", B^) (47) 

{X, X", W, n^yli'", nSB^'", B^'", B^-") 

^ (X, X, T^, 0, 0, 0, 0, S^) (48) 

where A^ = t; B^ , B^ , B^ and B^ are standard Brownian motions defined on an extension of the 
space W , with dimensions d^, d^, \I\ x dx and |I| respectively. 

Moreover, we have {B^ , B^ , B^ , W} are independent; {B^ , B^ , B^ , W} are independent, and 
B^-^ , ^/nB^'"- and B^'" are "good" in the sense of Theorem 5.8. 

The proof of Proposition 5.10 will be given in section 7.1. 

Proposition 5.11. Under the assumptions and notation of Proposition 5.1, assume thatr^ > 
in ("Hs.s ), and that there is > such that 

p[<;/2+i] 

lim =C2n-fe +o(n-fe) (49) 

^ M 

where is defined in (32). Let 

p = l{0o>^a(/32 A (/3o - /?i)) + l{0o<p,}Wo A (/3i - M). (50) 
i) Let be the dx x dx matrix defined component-wise as 

<^'p'{x) -=^0^1 {<J*Dy(j)p.ix,y),a*Dy(j)F,{x,y))^i^dy), 

where (ppi is the solutions of the Poisson equation (17) with source F\ Let 

(Pf{x) := l{p^>p„}y/^F{x); Rf^x) := -l{/3o>/Ji}Ci / v^jf {x , v) IJ-"" {dy) , 
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standard Gaussian variables {i^^,'"},igN.;o<fe<ri;i<j:<d^ ; such that each i^^'" is J-f^ measurable 
and 



with the square root meaning the Cholesky root. Then, there exist a family of independent 

^fc"}nGN';0<fe<ri;i<!:<d,,. such that cach v]^'' 

2' 

for all x e M''- . 



E 



0{n 



a) In the SDE case (h ^ 0), define in a similar way a d^ dimensional random function Rh and 
a d^. X d^ dimensional random function ^h, with 



{x) 1{/3i>a,}V*h(2;); Rni^) ■= -l{/Jo>/9i}Ci / v'}fi^Ax,y)l^''{dy), 



Then, there exist a family of independent standard Gaussian variables {j^^'"''"}neN*;0</£<n;0<i jXd^ j 
such that each v]^'''^ is measurable and 



E 



i',j' = l 



for all X E M''^ . Moreover, letting Rq, <~pq be defined component-wise for < z', j' < d^ as 



^-1 ■ , 



R'h'-2Y: R'g G 

i^i k—1 



Rg - 



2G'^' 



1,1,1 ,7 



2G' 



and for i > j 



i?^^ - R'^'G''^ - J2 (Rg G''^ + Ra G'^^) 
-fa G 'J - 



R^ 



Ther 



E 



'j'=i 



0(n 



Proof. i) We prove the first claim. We use the expansion of Proposition 4.7 as in Proposition 
5.f, and estimates (27), (28), (29), (35), (36); to get for any x that 



E 



iF\x) - F^---{x, ?))- — ( Np.,m{x, q) + ,,j{x, q) 

J- M 



K /t.[?/2+1]- 



(51) 
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Let us examine separately three cases depending on the relation between /3o and /3i : 
• If A >/3i: 



M 



M 



i M V i M _ Oin^" 



M 



Co 



(52) 



We can rescale (51) to get 



E 



-[^/21 
■ M 



(i.'(a;)_i.^;"(a;,q)) 



^^FvA/(a^, q) + :q^^F-,A/(^' 

A/ 



M 



r 



.[<;/2+i] ^ 

M 

p['.72l 



.[?/2] 
Af , 



(53) 



so that the difference converges uniformly towards in And from (28) we have 



E 



M 



= o 



Ta/ 



(54) 



Let us define 



M 



^FSA/C^'?) ■■=Y.^fv'^ {^,Y^-\) (55) 

k=l 



for vY^' defined in 23. We can compare {VH^^)-^ A''^, and (rjj/^l)-!^^,. in L2 by 
(26). Indeed, thanks to controls (35) and (36), we have that 



E 



M 



= E 



fc=l 



< 



r 



(rk/2])2 



o 



(56) 



Substitute the corresponding terms in (53) to get thanks to (56) and (54) in (53) that 

I^Af 



E 



1 



M 



M 



o 



I 



\ 



-[?/2+l]' 
M 

p[<j/2l 



M 



Hence, to prove our claim, it suffices to show that 



E 



M 



Now, (52) and Tm ^ 00 imply T 



?/2] 
M 



CO. Moreover, from the assumed regularity 
hypothesis, Vp^ {x,y) is C^'l Therefore, Proposition 4.14 guaranties the existence of 



23 



a solution to the centered Poisson equation with source (x, y) of the same regularity, 
and thus 4.10 shows that A^^^ j^{x,q) converges uniformly with respect to x in to 
—Rp{x) with rate (/3o — (3i) A (32 > p since 



K 



[^/2+l]^2 
M 



< K 
= 0{n 



i M + (i M ) 



^2((/3o-/3i)A,32) 



)■ 



If /?! > /3o: In this case we get from (52) that Jj, — — > 0. Moreover by rescaling (51) we 
get 



E 



/T^jiF\x)-F^-'^\x,q)) 



1 



--NF',M{x,q) + 



M 



1 



M 



O 



//p[?/2+l]^2 
^ M 



M 



1 



But from (36) 



Hence, 



E 



M 



o 



M 



E 



/f^(FXa;)-F^^"(a^,9)) + 




0(n 



-2(ft-/3o) 



So it remains to consider the Nm term. Note that since the are independent standard 
Gaussian vectors, {Co\/TJj)~^Npi ]^,j{x, q) when i ranges 1, . . . , c?^; is a Gaussian vector. 
Let us study its covariance matrix Using (25) we get for i, j = 1, . . . , n 



1 



M 



NF',M{x,q)NFj^M{x,q') 



^Y'^^ix^q) :=E 

M 

E lk{a*{-)Dy<t>F.{-),a*{-)DyC^F.{-)){x,Y^L\). 

k.k' = l 



Define ip^ 



(the Cholesky decomposition). Then, there exists a family of in- 



dependent gaussian variables vl'^'", -Ff^. -measurable such that (Tm) ^Npi ]^i{x,q) 



Moreover from Proposition 4.5 and Proposition 5.1 we have that 



<I>^(x, g) converges uniformly in x in LP' to '^p{x) as defined in the claim with rate 
0(n-'3). By Theorem 4.2 we get the same uniform convergence for Lp^. The claim 
follows in this case. 

• The case /3o = /?! is straightforward from what has been proven in the previous cases. 

ii) Since H,H" satisfy the same properties as F,F", we get the claim for R^, fn and i^^'"*'" by 
analogous arguments. Replacing this result in the sensitivity of the Cholesky procedure given 
in Lemma 4.3, and taking into account the independence of the Gaussian entries, we get the 
claim for Rg and (pc- 

□ 
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Let {vn} be a sequence of increasing positive numbers and let us consider the sequence of 
rescaled error processes C", defined by 

We can show that this sequence of processes converges in distribution in the uniform conver- 
gence topology to a process C defined as the solution to a certain stochastic differential equation. 
We divide the analysis in two main cases: a first one in which G{x) = 0, i.e. when X is the 
solution to an ordinary differential equation; and the case when G(x) is non degenerate. Just as 
in the asymptotic error obtained for the usual stochastic Euler method given in Jacod and Protter 
[1998], we will obtain different rates and different components in the equation for both cases. 

Theorem 5.12 (Limit distribution). Under the assumptions and notation of Proposition 5.11, 
let Rf,ipf, Rcy^G be defined as in Proposition 5.11 and (3 defined in (34). 

i) (ODE case- G{x) = 0.) Let be the Brownian process given in Proposition 5.10. Let 
r = min{l, 1/2 + /3}, and suppose p> r — (3. Let 

Q := n^{Xt - Xr). 

Then ^" in the uniform convergence sense, where C,°° is solution of the system 

= E (^J^ d,.F\X,)C^^^ds + l{p>,/2}l d,,F\X.,)F^iX,)ds^ 

+ l{0<i/2} ^ irAX.)ds + Y.l ^FiX.)dBl-'^ . (57) 

ii) (SDE case - G{x) 7^ Let B^ and B^ be the independent Brownian processes given in 
Proposition 5.10. Let r = min{l/2,/3} and 

cr := n^ixt - xr). 

Then =^ C.°° , where is solution of the system for i — I, . . . , d^ of 
= E (/ d^^F^X^XT^'ds + 1^ R'^{X^)dWi 

l{/5<i/2} E f^:^''iXs)dB'/'''^ 

E f d,,G^'\x,)(:^-^dw, 

,- ,_i Jo 



(58) 



l{/3<l/2} 



+ l{^>i/2}4^ E f d^,G^\X,)&^\X,)dBl^^^K 

Proof, a) Assume we are in the SDE case. We have from the definition of that 

cr = {f{X,) - F^{Xl,s)) ds + j'^ (g{X,) - G"(l^, s)) dW,. (59) 



Let us examine each one of these terms separately. Denoting by the i — th component of x, 
let x,y & M'*^ . We define the set of vectors A^{x, y) 



A'{x,y) 



X for j = 

(yi, 2/2, • ■ • , yj,Xj+i,x-j+2, ...,XdJ* for I < j < d^ 
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and 



A^FU..A- 1 { F\A^-\x,y))-F'{A^{x,y)) \ 



and recalling that 



we have 



Jo L 



n'^(i^*(X,) - F\X^))ds + J^n"- (^F\X^) - F'iXl)'^ ds+ 

(^F\x:)-F''^{X:,s))ds 

n-A^F\X,,X:){Xl-Xl'^) 

+ n'A^F'iX:, X:)F^iX:){s - s) 

+ J2n'^^'F\x:,X2)&^\Xl){Wi - W'^ 
1=1 

+ if-P I vP {f\XI) - s)) ds. 



ds 



Following the same approach we obtain for each I = 1 . . . ,dx 



dWi. 



■ \^G'-\Xs)-&-^-"{X2,s) 

: WA^G'''{Xs,X:){Xi - xr) 

Jo . L 

+ n''A^G''^{X^,X2)F\X2){s - s) 

+ Y,n''A^G'''{X^,X2)G^'''{X2){W^ - W^) 

k=l 

+ n'-^ (g''\X2) - s)) dW^ 



dWt 



By identifying terms in the obvious way, we write 

Jo i^-^ Jo 



where Q\, Q2 are dx dimensional random processes with components 

Q{''"{s) = A^F\X,,X^) Qi'''''"{s) = A^G'''{X„X^) 
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and 



Jo 



3 L 



1=1 

t dj, 



ds 



E 



k = l 



rf/^^G''\X'^,Xl)G'^'''{Xl){W^ - W^) 
(g''\XI) - G*^''"(X^,s)) dWl 



dWt 



b) In this step, we propose another diffusion with nicer coefScients and study its convergence. We 
claim that both diffusions share the same limit distribution. Let 

cr = {p[^-{t)+Pi^-{t))+ f\Q^{s)rQ)ds+Y. [\Q2'''{^),c)dwi. 

Jo Jo 



where 



Pr{s)^7, / n^{^F\Xs),F{Xs))dA° 



f2 fn^{yF\X,),G-\X,)}dAl^'-^ 
1=1 ■'^ 

[ rf{VG'\Xs),F{Xs))dB''/^^ 
Jo 

£ ^ f vr{VG-\X,)G-'\X,))dB, 
, , , V2 Jo 



2;fc,/,n 



t d. 



n 

,777^1 "'0 



j.k,l=l 



t d^ 



Y,P'^{X.,)dWl 



/ Y,^y{X,)dBl^^^^ + n--P [ R}p{X,)ds, 
Jo .^-^^ Jo 



for Rp, Rg, ifp, ifQ defined in Proposition 5.11. By {T-Ls.s.), F, G are bounded; by Lemma 4.13, 
Vi^ and VG are well defined, bounded, and have bounded derivatives; and from the definition 
of Rp,Rg,'Pf,'Pg are Gj^ 

Note that (48) in Proposition 5.10 gives us goodness and convergence of the tuple n^A^'^, n^A^'"^, 
^r^o,n^^i,n ,^r^2,«^53,« Hcuce, by virtue of Theorem 5.4 in Kurtz and Protter [1991a] 
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A T^) is tight and any limit point will satisfy (58) on the interval [0,tx] where tk — 
(inf{t : |C(i)l > K} AT). Moreover 



sup ||p:| 

0<S<TK 



sup ||Q?(s)||, 

0<S<TK 



sup |lQ^(s)|l; 

0<S<TK 



are tight. 



c) We prove now that both and C" have the same limit on the interval [0, tk]- By Theorem 5.9, 
it sufhees to prove that sup norm of the difference of the coeffieients converge in probability. 
By Theorem 5.6 the regularity properties of F and the mean value theorem we have 



E 



sup \Qrit)-Qr{t)\ 

0<t<TK 



< E 



sup\D^F{x)\ sup \Xt-Xt 

X 0<t<TK 



-> 0. 



The terms of Q2 , P" are treated in the same way. On the other hand, we get from Corollary 
5.4, Proposition 4.1, and Burckholder-Davis-Gundy inequality that 



sup 

0<t<T 



E 



ix:)ds, 



sup 

0<t<T 



(g''^(-)-G'*'^'"(-,s)) 



{x^)dwi 



are tight and converge to zero. 

Thus, by Theorem 5.9 we will have that C*'" and C*'" will converge to the same limit. 

d) Finally, note that r]^ — > cxi and r^f — >■ 00, proving our claim in the SDE case. 

e) To prove i) it suffices to follow the same approach. We obtain an equivalent development for 
the ODE case (replacing by zero the "G-term"). The rest of the proof proceeds as before, this 
time using (47) for the weak convergence of the tuple. 

□ 

Remark 5.13. li /3 > 1/2 in Theorem 5.12, the error of the Euler scheme dominates: we recover 
the limit distribution error for an Euler scheme with exact coefficients given in Kurtz and Protter 
[1991b] or Jacod and Protter [1998]. By contrast, if /3 < 1/2, it is the decreasing Euler estimate 
error that becomes dominant. Since a higher /3 is general only achieved by paying a higher price 
in the required number of steps for the decreasing Euler step, the optimal choice implies fixing 
/3-1/2. 

Proof of Theorem 3.2. The result is obtained, from Theorems 5.6 and 5.12, by verifying the con- 
ditions imposed in those theorems. 

The sequence defined as 7fc = jok"^ for < 6* < 1 satisfies Hypothesis (H^). Recall that we 
fixed M{n) = Min^/'^^~^\ and we have for n large enough 



rltf ^ (i-g)Mr^^'/^-^^V^^ 
i-e ' Fm 1-^9/2 



-[^/2] 
■ M 
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So that we get from Proposition 5.11, that /3o = 1/2 and 

On 



/3i = 



1-1 



/32 = 



1 



1 - 



(1 - 

1 - 29 



Recall that is defined in (32) and stands for the first non-zero term in the error expansion of 
the decreasing Eulcr estimator. Let us assume we are in the more general case when it attains its 
minimal value ^ = 4. Hence 

^ (1 - 6l)Mf ^ 



/3i - 



Ci = 



1-9' ~" 1-29 ■ 
Then, from the conditions of Theorem 5.12 we have for the ODE case 



r = 1 A 



1 



1 



1 



+ /^ =o + U^/3 =o + UA(/3oA/3i) =-+/3 



1 



since we should have p > r — f3 — 1/2, we must verify 

|/3o-/3i' ^ 



1 - 



>P> 



which is the case ii 9 G [1/2, 1). Moreover, since in this case /3i > 1 > /3o = 1/2, we get r = 1/2, 
and the Rp term disappears. 

For the SDE case, we have r = /3 — min(l/2, 9/{l — 9)) the only restriction comes from imposing 
/3 = 1/2. This is obtained for 1/3 < 6* < 1. Note that the Rq term is different from zero only if 
6* = 1/3. 

Let us consider now the case <r > 4. From the constraints 9 E [1/2,1) in the ODE case 
and 9 G [1/3,1) in the SDE case, we deduce /3i > /3o = 1/2, /3i > P2, and in the ODE case 
/3i > /3o + 1/2, and the result follows. Note that in both cases the Rg term is zero. □ 

Clearly, from the proof of Theorem 3.2 shows that knowing a priori that > 4, would allow 
for lower inferior bound for 9 in the theorem. Since in general we do not know we stay with the 
sometimes sub-optimal limits. 



6 Convergence results for the EMsDS algorithm 

Given the error expansion for the decreasing step algorithm presented in Proposition 4.7, it seems 
natural to explore if a Richardson- Romberg extrapolation may be used to obtain the approximation 
with the same convergence properties we have proven. The idea of such a procedure is to decrease 
the complexity by performing a linear combination of two (or more) realizations of the algorithm 
with carefully chosen parameters. We borrow here the procedure as defined in Lemairc [2005]. 

Let A be a positive real. If {■jk} is a sequence of steps satisfying Hx, the sequence 7^ := ^ 
will also satisfy (Hx). We will denote P^^ and P^}' the sum of the 7^ and its power as before. 

Let us denote by F^'^'\x,q) the approximation as defined in (8) when the coefhcients {7^} 
are used. 

Let <j defined in (32). We define an extrapolated approximation estimator as 

F'-^''^(-\x,q) = ^^T^^r^T {x'/'-'F^^''(-\x,q) - F'''(-\x,q)) (60) 

The first question we might ask is if estimator (GO) does converge to the actual ergodic average, 
and what type of properties it inherits. To clarify the situation consider an extension of (2). Let 
Y = {Y^,Y^)* with 

Y,'-'^=yl+ j b{xXnds+ j a{x,Y^ndWl 
Jo Jo 
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If and are independent, then this system satisfies (H/.s.) with a unique invariant measure 
defined by fP{dy) = fx^ {dy^) ji^ [dy^) . If we define 

Rx.y) ■■= J^jA^ {x^/'-'f{x,y')-fix,y')) , (62) 

and defining in an analogous way h, then it can be seen that /, g, h := g*g satisfy (Hs.s.)- Moreover 
if we apply the decreasing step algorithm to / (respectively h) in the extended framework, we 
obtain the expression (60). Hence, we conclude that the EMsDS algorithm is equivalent to the 
MsDS algorithm applied to an extended system. 

Let us denote by X" the approximation of the diffusion X using the extrapolated version of the 
algorithm. In view of the discussion we presented before, the following result is just a re-statement 
of Theorems 5.6 and 5.12. 

Corollary 6.1 (of Theorems 5.6 and 5.12). Under the hypothesis and notation of Theorems 5.6 
and 5.12. 

• X" converges strongly to X . 

• Suppose that r^ > q + A and 

^[^/s+i] . . p[<;/2+2] 

-M. ^ c,n-^^ + o(n-^^ ) ; -fj-^ = C^n-f'^ + oin^^ ) (63) 

Define 

- (A^-^ + 1)^/^ 

Then, the error process :— X^ — X satisfies the C.L.T like result presented in Theorem 
5.12 with f, p, Rf, Rh, V'f, V'h given by 

f' = min(/3o,^i); 

P = l{/3o>^i}(^2 A (/?o - /3i)) + l{^„<;3i}(/^o A (/3i - /3o)); 
^f{x) := l^^^^^^yC^\/h4x~); ipcix) := l^^^^^^yC^\/ ^g{x); 
ITAx) := l{^^>^^j(7i(l - A-i) J v]+'''-\x,y)t,%dy); 



i?^^^(x):=l{^^>^^jCi(l-A-^) j v^^r {x,y)t^^dy). 

Proof. As was highlighted in the discussion preceding the Corollary, the EMsDS algorithm is 
the MsDS algorithm applied to an extended system, and hence the strong convergence and limit 
distribution properties are a consequence from Theorems 5.6 and 5.12: it remains just to express 
the values of the functions and constants appearing in Propositions 5.1 and 5.11 in terms of the 
original system. Indeed, recall that 

By i) in Proposition 5.1 apphed to the extended problem (i.e for the system (61) and / defined in 
(62)), we have a solution for the extended centered Poisson equation given by 

$pi{x,y) = _ ^ {\'^/'^4>F^{x,y'^) ~ (j)F'{x,y'^)'j , 
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i.e., the solution of equation (17) with function under the extended set-up is a hnear combination 
of the sohition in the original set-up. Thus, for any j > 0, 



1 



It follows that 



(66) 



^J-[\^ DlMx,y')E 
1 



Kx,y^) 

A 



aix^ 



(67) 



Therefore 

-;^(?-0/2 _ l- 

A':/2-i - 1 

and we deduce that the terms of the error expansion will be zero for I < <; + 1. 

Let C be defined by (32) under the extended setup. From (67) we conclude that (f = <^ -I- 2. 
Hence, we deduce that /3i, /32 defined in (63) are the corresponding ones in Proposition 5.1, and 
that Rp is the functions appearing in Proposition 5.11. Similar developments for H allow to 
extend the conclusion to . 

On the other hand, looking at the definition of (pp and $i? from Proposition 5.11 and (66) we 
get that 

^Fi^) = ^x^/^\_i)2 {^''"1 {<^*Dy^p.,a*Dy<l^p^){x,y^)n^{dy^) 

+ j {a*Dy<j)p^,a*Dyq^p,)ix,y^)^i^dy^) 

i.e. <l>_F(a;) = (A'^^^ + 1){X'^/^^^ - l)^'^^p{x). We get a similar result or I>g. We obtain the value 
Ctp given in (64). The claim follows. □ 

Proof of Theorem 3.3. We apply Corollary 6.1 to the presented particular framework. As in the 
proof of 3.2, we deal with the most general case <r = 4, ("H^) is satisfied and the powers and 
constants we need to determine are given by: 



M 



^[3] 
^ M 



7^(1 - e)M--"'n-^ 
1-36' 



p[4] 

r[3] 



7o(l - 39)M-^n-^e 
1-461 



hence 



261 



(A3 + 1)1/2 



A - 1 

For the ODE case. Theorem 5.12 asks for 

1 



1-30 



1 26* 



p > r ~ p — min ^ 2 ' "'^ ^ "cah^ 

because r = min(l, 1/2 + min(l/2, 26*7(1 - 6*))). Hence, 

29 



l/?o - /3i 



1 

2 " r 



2' 1 



>P> 
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which is the case ii 9 E [1/3, 1), and implying /3i > 1 > (Sq. Note that in this interval we have 
r = 1/2 as wanted. 

For the SDE case, we have r = /3 = min(l/2, 26'/(l — 9)), so that to have r = 1/2, we ask for 
1/5<6I<1. □ 

Remark 6.2. We remark that C^p is a constant multiplying the uncertainty coming from the 
decreasing step estimator. Since we would like this quantity as small as possible, having an 
explicit value for is very useful from a numerical point of view: we can choose A to minimize 
C^. In the general case = 4 we get 

A, = 1 + (\/3 + 1)1/3 + (VS + l)-i/3 w 3.196 

inducing ~ 2.64. This is the initial additional cost that has to be paid for the extrapolation, 
making the EMsDS algorithm useful for large n, where the reduction in complexity of the EMsDS 
is enough to compensate for the higher error, as seen in the numerical tests of section 3.3. 



7 Technical results 



7.1 Weak convergence of tuples 

Proof of Proposition 5.10. a) Let us start by proving (47). Note that the approximations defined 
by (9) are defined in the same sample space of the effective equation (3) and that we have 
thanks to Theorem 5.6 that 



sup 

0<s<t 



•0. 



Hence, 

(x,i:",H/) ^ {x,x,w). 

Now, 71^1'''" is deterministic, continuous and 

't^ [nt\{[nt\ - 1) 



lim 7iA('" — lim 2n 



2n2 



= t. 



an the convergence is uniform in t. 

On the other hand, we can easily verify that for any t, and 1 < « < 



but by Cauchy-Schwarz inequality we have 

' nt — \ nt\ , 



nt — \ nt\ 
n3/2 



E 



sup 

0<t<T 



,3/2 



< E 



" 1 

E I i:n\ 



< E 



i\n\2 



^ 0. 



then, it suffices to study the convergence of the Gaussian martingale X]["o Let 
< j < dx, then the independence properties and an application of a multi-dimensional 
C.L.T. gives us that 

/[nt] [nt] \ L"tJ 



i=0 



1=0 



We conclude that is (up to a modification) a Brownian motion independent from W and 
X, by remarking its Gaussian nature with independent increments property and covariance 
matrix as the one of the standard Brownian and hence (47) follows. Note that we have as well 
shown property (*) and consequently goodness of the sequence. 
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b) To prove (48) note first that y/nB'^'-'^'^''^ is a continuous martingale. In view of the results in 
Jacod [1997], we examine the component- wise quadratic variation. By standard techniques we 
find 

{V^B^''''^''^,V^B^''' t = 2n f {Wl - Wl){Wl' - w[)ds 

Jo 

and due to independence we find as well that, taking, j ^ j', 



■0 



0. 



By Theorem 4-1 in Jacod [1997], B^'" convergences stably in law towards B^ a standard 
Brownian Motion independent from W (for the definition of this type of convergence see Aldous 
and Eagleson [1978] or Jacod [1997]). Since all the processes are continuous, convergence stably 
in law implies joint convergence. Therefore considering (68), we have 

{X,X'\W,B^'''') ^ {X,X,W,B^). 

Note that we proved tightness of the quadratic variation of the martingale y/nB^'", so that it 
has property (*), and therefore it is good. 

Now, B^'" is also a continuous Gaussian martingale, so that we can make use again of Theo- 
rem 4-1 in Jacod [1997]. Let us check the convergence in probability of its quadratic variation 
towards tl and of its quadratic covariation with respect to the other martingales. Indeed, it is 
straightforward that if j ^ j' , (ij3;4j;n^ ^3:i j :n^)^ _ while we deduce from the multidimen- 
sional C.L.T (_B3;«,i;n^ ,j;n^^ As before this also shows goodness of B-^'". Using 
the same techniques we prove for any i,j,l that 



(B 



3;l.j;n 



= 0, and (S^^''^'", ly) = 0. 



Hence 



{X,X'^'^\W,B^''\B^'''') ^ {X,X,W,B^,B^). 



We prove now the convergence in probability towards zero of the remaining terms in the left 
side tuple in (48). 

Since n^^/^ ^ and nA"'" ^ A°,we have n^/^^o^" ^ and thus ni/^A"'" -A 
On the other hand, for any t > and fc. 



•0. 



Jo 



L«tJ 



l/n 



r dr 



t-lntj/n [ntj+l 

r'dr< J2 -^'--^ 



3n 



2 =0(n-^). 



So that by Burckholder-Davis-Gundy inequality, E 



sup \^/nB' 

0<t<T 



0:n\2 



tends to zero as n — >■ oo, 



implying y/nB' 



0;ri 



• . In addition, it can be readily seen that 
E [InAi'^^^^vli'^''"]] ==0 
for j ^ k, so that we have by using convex and Cauchy-Schwarz inequalities. 



E 



sup I 

.0<t<T 



l-n\2 



<nTj2 



E 



< 



d:rT 
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hence, by the law of large numbers, y/nA^'^ — >E [y/nA^'^] = 0. 

Fmally, as y/nB^'"- converges in law to a Brownian, S^;" — ?1>0. Therefore (48) is proved. 

□ 
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